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The Study Grbup^bh the Cphditibhs of ExceXleh in 
Higher Educatiphwas appointed in Octbber_1983 by the* 
of the National Institute of Education (NIE) to: (1) review 
background materials froiti the archives bf the National 
Commission on Excellence it^ Education (NCEE); (2) review other 
background materials in other recent reports; (3) advise the director 
of NIE on further Uses of those mater ials ; and (4) suggest ways in 
which policy analysis and recomme for improvement in Amer ic|Ln 

higher education canv be deyel^ This first report 

presents a general assessment of the background materials , begins the 
discussions of issues related to excellence in higher education , and 
makes a limited set of reconunendat^ons. Background materia 
included those of the National Commission^on Higher Education Issues 
jAihericah Council bh Education, "To Strengthen Quality in Higher 
Educatibn"), the Business-Higher Education Forum ("Americans 
Cbmpetitive Challenge" ) , the National Cbmmissibh on Student Financial' 
Assistance ("Sighs bf Trouble and Erosion" and "The Terrain of 
Fbstsecbhdary Education"),^ and , primarily ^ the NCEE i"A Nation at 
Risk"). Areas bf inquiry focused bh: student clientele ; prbgrams and 
learning ehvirbhmehts bf iiist itut ibhs ; "providers" bf 'undergraduate 
baccalaureate educatibh; and the external influences bh higher 
education. Recpiiiinehdat iohs are offered regardii^ educatibh data 
collectipn/ahalysis, the NIE leadership role inrevitalizihg the 
Federal Interagency Coimnission on Education (FICE) and bther areas ^ 
and the focus of research at NIE labs and cetiters, ^ (LB) 
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I - ' 

. • , , The Progress of an Agenda: 

; • * A First Report ^from the Stady Group on the Conditions 

' of ExcerTence fh American Higher Edacatlon " 

J* . • . 

_» _ _ . « 

U I ntroduction 

The Study Group on the Cdhdltlohs of Excellence In American Higher Education 

was appointed by Dr. Majwjel Just 1 2; D I rector of the National Institute of. ' 

Educatjori, In October, 19.83.\^The Group will meet seven times over an^ll-morith 

period and will present Its final report In August of 1984. The Group- has been 

charged with the fbi lowing tasS^s: • • / 

\ ' ' ■ » 

i\} To review and analyze the background materials relevance to 

" _ " " ■ j 

excellence In higher education from the archives of the National 

Cdmmlssloh oh Excellence In Education (NCEE); * , 

— •- - _ _ 

(2) To review arid arialyze the background materials of relevance to 

- w - - - ' - - - ^ 

excelr^ce Iri higher educatibri of other reeerit reports and 

commissions; 

- - _ * _ _ _ 

(3) To advise the Director of NIE coricerrilrig further uses of the 

« 

materials; and 

(4) To suggest ways Iri which policy analysis and recommendations for 
Imprbverherit Iri Amerlcari higher education can be developed and 

^ Implemerited, ' ^ 

i ------ - _ - • ~ ^ 

In Its first meeting^ the Study Group determined that this comprehensive charge 
can be met effectively drily If ari agerida for Improving quality Iri hlgher 
^ education Is developed first. This agenda^ Iri turri^ requires a searchfrig arid 
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cbmprehehslve conception of qua I Ify or excel ijerice to advance the discussions 
that have been stimulated by the various commission reports, it also requires* 
conslderatlbh of what society can reasonably expect from higher education, and 
an assessment of the roll of pbstsecondary Institutions In student lei^Rlhg and 
development* - z .1 ■ 

The SrQop has been charged to focus' Its wbrk on ondergrodaate education and has 
delimited that^focus to undergraduate bdcc^l aurU-h^ education. This governing 
concept Includes alt students (tradltlbriil aged and adulj-) pursuing an • ^ " 
education that can lead to a baccalaul^eate degree. Such education Is ^ound In 
a variety of contexts. Including all traditional four-year colleges and 
universities, community colleges with "general studies!" and/or trahsfer 
, progrank, and a variety of non-trad I tlona I degree-g'rahtlhg^6rgah Izatlbhs, We_ 
r cbhslder any aspect of educational policy and practice that affects 

V • : . : ' ■ • . - 

^ undergraduate education to be within the scope of our work. It Is bur 

_-_ _ _- _ ■ . _ ' 

fuhdamehtal assumption that questions of eHucatlonaJ research and policy 

( Instltut iQhal and public) about pos^secondary education must be linked to 
teaching and learning. Thus, our principal Interest Is In undergraduate 
students and prograw^s . 



- — ■ / 



This document, the first of two repbrts In bur charge^ wllf: 

(1) Present a general assessment of the arcH lve$' and background materials 

' - ; _ _ >__.____■/]_ 

on higher education assembled by the-Warllous nat I ohaT commissions 
. . that have reported to the.Arrierlcah pubNc during t^e past yeV; 

. > (2) Begin bur d jscussjon of Issues cbhcerhlhg the conditions of 

excellence In higfier education that wllh be elaborated In'bur final 
Report; and ^ • . 
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(3) Hake a Mmlte^J 'set of recommendations approprla+e either to the 
^materials we havre examined or to the, scOpe of. pur drscuss^^lons to 

i date. i. .. :: , . ^j... ■ \ .■ 

- \ ^ - ' " t ♦* ^ ^ 

in accordance with our fehar^e/ the' Final iRepdrt of *the Study-grotjp;: wl j j propose 
^n agencja' .f pr^ Improving excel fence with equity In undergraduate baccalaureates- 
education that' IS rooted In the findings of research. The Flha4 Report- will 
cite the most relevant ex 1st I n|^ knowledge^ will point to ways pdstsecbndary 
Inst I tut Ions can use theft knowledge In Fmprdvirhent efforts^' and. will propose 



strategies for the more effective dissem Inatidh of what we khb* «bout . 

; ' ' - - f - ■ ■ ' . ' . 

^successful practices. \ ^ ^ ; ' . * 

Our Final Report^ will also off 4r a research^agenda that would al'd In acfilevtng 
the Qbjectlves set forth. The Study Srogp has determined f hat such a research 
agenda can be elaborated only In the context of what the. Director of NIE 
referred to as a "blueprint" for Imprbvementi The recommendations fbr 
improvement to be offered In ftye Final Report will be addressed principally to 
faculty, studerits, admihlstratbrs arid trus^ of pbstsecoridary Irist Itutfons, \ 
and to the general publ Ic. The recommeridatlbris cbricerrilrig research will be 
addressed principally to federal and state agencies. .. . 

1 U Backoround Materials of the C ommissions 

The Study Group arid Its staf fc have reviewed the reports and background 

^ ^ - / ^ _r _ _ ' . 

materials of Tour differerit groups that release^-tnelr analyses and 
recdmmendatlbris over the past year: . " - . 

m. The National Canmlsslbri bri Higher Educatlbri I ssues CAinerlcari GbuncM on 
^ Edncarion^), To Streri^i^iafv Quai Ity fri Higher Education - 



V. 



• The Business-Higher EdUcatlbh Fbrurn^ Amerf^cats eqmpfitfti we Chai iflrigp > 

■ „' - ■ - . • ' » 

• The National Commission on Student Financial Assistance^ Sl^ris n i 
Trouble arvd Erosion and The terrain af PnstsBco ndars/^Eaniaitlfm ^ 

I • The National eommlssloh on Excellence In Education, A Nation at ^4^ ^ 

/ - _ __ ■ 

^ We wish to strpss at the butset that our reviews do not const jtute-^nor are ' 

tteey Interided to cbnsti tut^-a rebuttal or critique of the reports of these 

groups. Rather--ahd J h ^keeping with bur assignment — these are analyses and' 

assessments of the backorQuhd mater I a assembled by these ^rbups in the course 

of their work. .Furthermore^ we recbgnize that none of these groups set out to 

review and/or synthesize the existing literature oh higher education^' nor were 

they charged to 6^ so. fhus^ we did riot Ib<* at the backgrburid materla|^-ln 

iwj" ■ ■ , ' ^ , ' - 

terms of what wps missing as ' much as we used than tq brgariize bur bwJi thoughts' 

__' . " ' . ' 

on higher education. ^ ^ 

,* - . ^ 

We have alio read the final, report of the National Cdmrrilsslbri pri the Higher 
Educai-Lon 6t Minorities (1981) and th'e final report and minutes of the Nat*Ibrial 
Advisory GbuncM on ebnt I,nu I ng Education. As we work toward our' final report^ 
we are systanatlcai ly collecting materials from other Important 
commlsslohs-rn-prbgressjr most notably the Project on the Wean I ng oT the 
Baccalaureate of the American Association of Col leges and the A(4. Task Force on 
Higher Educatlori arid the Adult Learner i 

Of the documerits we examined^ the recbrd arid archives of the National 
Ccwmlsslon. on Excellence Iri Educatlbri Were most vbjumlribus^ arid our principal 
focus was on that record. Nonetheless^ Tf Is Impbrtarit to describe the nature 
and relevance of the background materials of the bther three groups In light of 
bur scope of Inquiry. v , ^ 



NattQriai Compsslon on High er EduGatfon issues . The ST-memblsr Natldhal 
Cbmrri I ss I bh' on Higher Education issues Was composed principal jy of coi lege 
presidents and other distlhgu Ished ^ebde^s of higher education, along with 
a few corporate find government officials. The Cdfnmlsslon held four 
meetings, and its repbi^t^ To Strencjitheh OuaH t 7 In Higher Eddcation , made 
recommendations on jsuch impbrtaht. top ics as leadership s^lection^ 
governance and cetitra I izati bh, f ihance^ cljrriculum^ tenure and post-tenure 
eval uation, 

Ajthodgh the commissioners decided "not tb be a study group, hot to have 
bac.kground papers prepared, and not to publish a vdlumlnbus report for 
wide circulation," certain strands of analysis in the small number of ^ 
concept papers and drafts of the e6rnmlsslbn*s work were of Interest to us, 
and Suggested some potentially profitable lines of Inquiry^ For example^ 
the papers emphasize the necessity of sorting but varying measures of 
quality In light of the different fuhctlbns bf higher education (from the 



direct provision of educational services tb ihfbrmatibri stbrage and 
-retrjevaj to the soclaj izatlon of young adults) and highlight the 
structural and contextual restrictions on innovation in colleges arid 
universitlisi They also ^Int to a critical distinction between "quality" 
and "integrity^" the latter a I lowing for judgment of a more diverse set of 
V Ihstltut ibnif missions than the formeri In this analysis, "Intjegrlty" 
Implies dplhg what Is realistically possible given resources^ capacities 
and cl lehtele. ^ » \ . 

/ • — ■ 

BusIness-HlQher Educatloh F orum , The report bf the' Business-Higher 
Education Forum, America's Cbmpet^lt- X)h£M4^^ was pre|)ared In response 
to ah Invitation from President Reagan to make "a set bf recbmmendatJbhs 



designed- to strengthen the ability of this nation to cx)mpete more 
effectively In the world marketplace." The Report takes as Its central 
prSnlse the assertion that /'our society must develop a cdri^ehsus that 
Industrial competitiveness oh a global scale Is crucial to our social and 
^ecdndmlc wel I being." The report hence' emphasizes business far more than 
higher elucatibh. • " , 



The background papers prepared for the For gm»s work are "think pieces" 
V employing generally accessible eeorromlc data. They focus on such topics 
as American science. Industrial policy^ America's competltl veh^ss In world 
trade, and Industry-university cbdperatlbh In researchi The concentratfbn 
on science and Industrial policy fh these papers results In discussions of 
The, types Of research fnb development that should be .funded by. the federal 
government and of the reform of management pract^^e^ le:\tf^e International 
marketplace. ' " - . - 

The Forum wascohcerhed with productivity; and th^ major studies pf 
productivity upon wfilch It drew did not rank the quality of labor as 
lmj)drtarit a factor as either capital Investment or ••tedhnplbgy fhq^^ 
whHe paying scwrie attehtlph +b structural ghemplbyment In an aging 
workforce, arid the necessity for a riatlbhal. approach to retraining, the 
papers analyze humah resou Hires'' principally as a scj^rice policy Issue with 
two dimensions^ (a) the supply and qual Ity of trained scientists and 
engineers, and (b) the technical ^ I Iteracy and tralhab M Ity of the general 
population. Some of the recbmmefidatlons offered In the papers, e.g. for' 
the professional develdpmeht of employed engineers and scientists, are 
more compai 1 Ing than the educatlbriai ahalysls~whlch focuses, brief ly, on 

V / _ _ _ _ _ . \ 

precox legJat^ science and mathematics educati bhi, oh cbl I.ege level 



©dttcatlbh In engineering, 6nd on adalt 1 iteracy. The Forum conciuded 
that^ "additional specific fepanmendatlons are needed less than Ganges 
that wi ii enhance the abii Itybt gbverhme to act on the proposal s It 
receives," .„ ' - » ^ 



National ^Ckxtlmiss^l^ on Studoht Financi al Assistanc e , The extensive 
background papers of the Congress ibha I iy^chartered 'Cbm^ cxivered hbt 

only micro-ecpnctnic analyses af specific pbi icy issues and the ecbhomlc 
' ^status and behavior of specific groups of students (e/§-. graduate 
students), but Si so broader questions of demcgraphy and the nature arid 
current conditions of spefcific sectors eff postsecqndary education* Many 
of the latter reports' and papers were condensed Into a single volume. The 
Terra Fri of Postse condary EduoflfTbrj p th«t prbv I des usef u I descr I pt I ve 
material for both poj icy makers arid the genera T pub I Ici 

Despite the' extent arid value of the descriptive material^ these papers db 
jnot address the issue of quality ij uridergraduate educatibri th^ Is ptir 
primary concern, T^ie basic data on patterns of student employment while 

In col legej for example, are vajuabje to have, but this knowledge would be 

^ _ ; ___ _ _ _ L'- _ . _ _ . _ _ . v _ _ . _ 

mqre valuable to us were It re j ated to^ student outcomes, . The d^ciinirig 

number of Amer lean students pursulhgvgr^duate degrees In^^he-^radltlqrisl 

atademic dlsclpUnes has serious consequences, s^jndeed, for the future of 

the academic wbrkforce^ But It" Is hard, to judget the degree of seriousness 

ilriless we also kribw sbmethlrig about the quaUty of both the students ind 

the: various graduate prbgrams they pursue-^rielther of which Dbhgress asked 

the Cbmm(sslbri tb dbcUmerit,' ^ ^_ * . 

_ ' I ^ " 

: 7 • ; 



The ebmmlsslon's background papers also Include Important reviews of both 
proprietary and empibyer-provlded education, but our understand i rig of 

• ^ ■ __ _ • \; 

- these areas Is st HI hampered by anreMable data— -an issue which we will 
address later In' this reports ' 

The National Commission on F yc e l le rtf^ ?n Efldn>i1-ton ' 

There ^are three reasons that our discussibri of the background materials ^ 
assernbied by the National. Commissi bri bij Excellence has been quantitatively and 
qualitatively different from our cohslderatlori of the other commissions. The 
final report of the commission and the extent of Its work oh higher education 
stimulated Dr. dust I z to appoint the Study Group and to charge us with bur 
tasks. In addition, A Nation at pj^K has dbmlnated the natlbi^l discosslori of 
educatlorial reform over the past yeari But most Impbrtaritiyi the archives of 
the ebmmlsslbri were riot only extensive (our staff catalc^ued over 500 •'basic'' 
documents), but very r|ch In substance; and we were prTvlleged to have access 
to far more thari the 41 comm fss I one d^ papers I Isted In the appendices of 
at Rl§K« Specifically, we examined selections frmi 

Testlmbriy delivered at ebmmlsslon meetings, hearings, and other public 
fbrums; , 

Staff briefings arid arialyses of educatlpriaP Issues considered by the 
Commlssi(|U^; ' _ 



• Letters from cbncerried cltlzeris^ teachers, and admlnlstritprs; 



and 
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• Descriptions of notable prbgraris arid promi^lrig approaches to specific 
educatlonat problems. ' ' J 

■ ^ ■ ' ' If) - : ' I: 



We look on this material as the most significant cbMectlbri of 'artifacts 
representing a national discussion of quality In educot I bh In bur time • While 
we have read them as aFtf facts — l*e» as products reflecting the attitudes^ 

bplhlbris^ beliefs, and knowledge. of American society In the early 1986s-~we 

_ _■ _ __ « _ _ _ t ■_ 

alsb recognize that the shape of ^he C?oi lection was dictated iargely by the 

Canmlsslbh's Charter, In calling lor a^cocnprehenslve review of "the quality of 

learning and teacl}li>g In the natlonis schools, col leges^ and universities^" 

Secretary Bel I took care to focas the Commission's work on ••the educational 

^xpSrlerice bf. teeh-age_ youth," It was thus Inevitable that the testimony, 

letters, arid cbmnplsslbried papers emphasize secondary education far more 'ths^n 

erther eionentary eaticatlbri or pk)stsecondary education. Indeed, we did not 

limit ourselves to thbse dc^merits dealing explicitly with postsecondary 

education (even though these account for a substantial pbrtlbh bf the 

Commission's archives). 

In approaching this material In ways that would help us Identify the 
"cbndltlons of excel lence" In American higher education, we adopted a 
conceptual framewbrk that was different from the one employed by the 
Commission, The Cbmmlsslbh brgahlzed all bt Its wdrk^ analysis, and 
recominehdatlbhs under the rubrics bf Tlme> Content^ Expectations, teaching, and 
Leadership, chb^ four tradltlbhal dimensions bf analysis In higher 
education: 



(1)/ Student clientele; 

i 



12) Programs and learning env I ronftfents of Institutions; 

• ■ ■ _ ■ * I 

13) "Prbvlders'' of undergraduate bacca laureate Ifeducat I oh (cbl leges* 

- ' \_ 

cbmmunlty cof leges^ universities and other organizations); arid 



i . • • - -.•■*. ^ > ^ 

(4) The ©xternal intluehces bh i)lgher ediscatlbn, t • * _ ^ : 

_ . ^. ^ _ _ _ . • • ; 

We then cbnsldered how th^ CSDmrnlssldh's materials were related to each * ^ 

d I men sfbhi Having work^^^ these analytical categbr les^'^d havlrig 

considered the Commission's conceptual framework^ we recommend that* at a 

y ■ 

♦- ^ _ ___ 

minimum^ NIE organize the archives of the Commlsslbh ( Including staff analyses^ 

-. Unsolicited submissions^ written testimony, and miscellaneous ddcumehts) In a \ ' 

coherent and cbmprehenslve fashion and place It In the ERIC system* In such a^ 

form that It can be retrieved wJih ^^crlptors that IncludjS both th/ ' 

Cdmmlsslbh's categbrles and bur categories. For faculty, administrators^ [ 

students, parents, and bthers Interested In the generic propertle^ of 

postsecondary Issues, such ah brgahlzatlon of the archives would be' useful. ^ 

Even more useful would be fbr NIE tb publfsh a voiunp con'talhing the major 

background papers ah^ materials bf the Commission dealing with higher, / 

-- ' _ V_ _ _ ^ _J I 

education. There ^^ar^ a number bf cr^ajflve ways to edl^t and arrange thl^ ; 

material 'for puf^poses of publ Icatlbh; arid the members bf the Study Group are 

willing to advise NIE further bri the cbriterit arid shape of such a vol ami. 

In the assessments that follow, we use dur fdUr categbrles arid cbricentrate on 
those documents from the Comm I ss lories archives that are most directly relevant^ 

to higher Education. However, we^lso Include sane materials that^ while ~^ 

- ' « ■ ■ ]. . . ^ 

concerned with teaching and learning at the elemetitary and secdridary levels^ 
are also significant for higher education. These materials dtial with the 
^ characteristics of effective schools, the; concept of time on task, motlvatldn 
arid academic wbrk^ and the matter of distinguishing standards and requirements. 
It Is bur cbriterit I bri that higher education has much to lear^n from the extension 
of ^stabl.lshed strarids bf research at the. school level to Its domain; and It Is 
our Intention td elaborate bri sbme bf these strands In bur own Final Reports 
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»jHfdeht g| ifrit^l^i The fflateriaT from the NCEE archives that Is nibst 
relevant to the characteristics and experience of students Includes 
discussions of the dembgraphTlcs of higher education, admissions standards 
and practices^ the transition^ from high school to college, and the 

Intluence of collies oh student course-taking behavldrMn secondary 

C' -_ - _ _ V __ _ ' 

schools. Ther^i Jare also Impbi^tant papers on changes In the preparation • 

_.(._■; ^ . . 

and aspirations of entering college freshmen over th^ past 15 years . 
(Astin) and the measurement of quality of stddeht effort and Its 
significance In understanding the achievement of college students In 
different types, of Inst I tut I oris (Pace). 

, ef addltlonaj value are the papers dh Ihtelllgehce (Sternberg and Wagner), 
academic work (Doyle), motivation (Stipek), and time on task (Karwelt). 
puestlons asked of some of these writers by. the' Cbmmlssloh staf f 
concerning the postsecondary dimensions of these Issues—partlcularl y 
mdtlvatlbh and academic work — are worth pursuing, particularly In light of 
Pace's demohstratlbri of the predictive and diagnostic value of the 
"quality of effort." the content of transcripts of discussions held among 
Gommlssloners and Chicago area students only underscores the reasons for 
following up on these questions, as the students stressed such critical 
chaMenges- of adapting to the dwnands of coj lege a$ learr^lhg how to manage 
their tlme^ hegbtlatlng bureaacratlc barriers, and establishing both 

^academic and personal Identities. 

Secretary Bej I charged the eommlsslon with exploring. a hypothesis 
concerning the Impact of cp I lege." admissions standards /'and lower division 
coarse Fequlranen.ts" on secondary school curricula and ach levemeht of 
secondary school students. The archives ref lect This focus' on col lege 
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admissions. The Study Group believes It Is more Important to consider the 
ways In which students can better choose Institutions, the ways colleges 

V ■_ ._ 

arid universities can edpcate studentSi as Implied In sane of the testimony 
to the Cbcnmlsslori, arid the ways In which students negotiate the college 
eriv I rbrimeriti 

From bur perspectl/e^ It Is the coritFast between those "lower division 
course requl rarierits" and the fcurrlculum as actually experienced by 
Students that may be most Instructive^ The orify way to get at that 
contrast Is through analysis of college student trariscrlpts. The 
Commission staff work cited Blackburn's earlier (1976) work In this 
regard; but It *ls clear that we heed a much more systematic and ' 
contemporary survey. 

It Is also our belief that minorities and adults have Ibrig-starid Irig unmet 
claims on higher education that are not consistent with the •'Input 
approach"' to quality (I.e. admit the right students, and you will have ah 
excellent college) that the emphasis on col lege admlssidh processes 
^ suggests i For example, a high proportion of minorities and adults 
currently partlclpatlrig In higher education are enrolled In cx>mmuhlty 
cblleges and other operi-dbor Iristl tutlons. The Commission archives have 
scxne testimony on Hispanic access to higher education and profiles of 
butreach and reteritlbn progrcSsi The Study Group believes there Is a need 
for more cbmpreherislve analyses and demonstrations of how to meet the 
educatlbhal heeds of thbse whb erirbl I jri operi-dbor Iristltutlbnsi^ 

One might assume from some bf the discussions surrburidi^g A Nation at Risk 
that If scxne students ahd/br ihstltutlbris are excel lent ^ then bthers can 
never be excellent. The Cbmmlssibh Itself certainly did not reach this 



cbhclUsIbri^ bi^t such a conventional notion about excellence Is implicit Ify 
sane of those dbcumehtSi The Study Group believes that discussions of 
excellence In higher education should I hclttde>^6nsl deration of Individual 
student learning arid develbpmerit and difference In Institutional Impact 
on student learning arid develbpmerit. \ 

^ In the matter ot student clientele^ there are questions that are more 
compelling to us and more relevarit to pbstsecbridary pract It Ibriers than 
those concerning aamlsslons. Questions such as the fbllbwirig are designed* 
tb lead us toward a full understanding of the ways Iri which educatlbrial 
erivlrbrimerits arid practices result In different outcomes of pbstsecbridary 
educatlbri for different kinds of students: 

• What courses of action are necessary to assist students In a ^ 
realistic assessment of themselves and their education? 

• Hbw should pbstsecbridary Institutions respond to shifts In the 
values of incoming studerits? 

• What are the benefits of postsecondary educatlbri accru I rig tb 
Individuals at different levels of ability? 

• What retention strategies are most effective for different student 
pbpulatlbris arid hbw might they be Implemented? 

Prograns and Loarhfrig Erivlrorimerits . The National Commission material 
relevarit tb a cbrisLderatlbri bf pbstsecbridary programs and learning 
.environments Inclul^s papers bri such tbplcs as gerieral and liberal 
education (Gamson), the col lege xurr leu lum (staff briefings arid arialysls)^/^ 
the quality ot pre-servlce teacher educatlbri programs CHbweyJ, and the 

13 . 



role of faculty in defining educational bbjiactlves and' performance 
IWarrenii Sane pf these papers are original cdntrlbutlbris or cogent 
syntheses^ and wMI be Important starting points for our own attempts to . 
1 1 lumlhate the task of mapping the qual ity or learning environments In 
higher education. 

When we approached the materials from this perspective, we were looking 
for detail on the relationship between progron content, teach I ng methods, 
and/or the characteristics of entire Institutions and what students 
actual ly learn and how they change. While we concluded that there are no 
systematFc comparlsdns of different approaches to progrSn content and 
internal environments In these archives^ we also found several potentially 
productive bodies of ni|sterlal: 

(1) The archives contain narratives and accounts of the evblutlbh bf 
Institutional environments that seem to have made a 
difference— particularly In terms of student expectatidhs and 
acaaemlc aspirations. Since only a few of these ••case histories" 
were gathered, we could not perform comparative analyses to Identify 
particular aspects of the learning environments that seem td have the 
greatest Impacts ^ In all fairness^ though, the broader literature on 
higher education Is sparsely populated by such ethnographic case 
studies. 

(2) The analysis bf the profiles In Starting with ^tndehts currently 
focuses dh prdgram structure^ teaching approaches^ curriculum and 
outcomes. W^lle that Ihformatlbh Is Instructive, we know that the 
profiles lying behind this report also cbhtalh Ihfbrmatlbh bri Issues 

__ . . . u ■ _ 

such as faculty Incentives, resources and trahsferabi I ity. We 
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reebftimerid that NIE conduct a more comprehensive reanalysls of this 
material and make It more access lb je. 

There are a number of Important quest Ions on •prbgrans arid learning 
environments that we will be refining and elaborating In the o^^pse of 
•eparlng our Final Report/ questions that were stimulated more by 



1 Inference than d-Irect treattnent Jn the bacRgroUnd mati^rlals assembled by 
t^ ComSlsslon. These questions Include: \ 

• What teaching and jearnlng practices and cUrrlcUla lead to the 
minimum competencies In basic skills currently being mahdated by 
state legislatures and postsecondary goverhlhg boards? What v 
Investments of\ time and dollars are" required to teach these ba§Ic 
ski I Is mor^^^ectlvely to a wide range of student groups? \^ 

• What teajrmng and learning practices lead to the development of ^ 
higher order thinking capacities (analysis, synthesis, translation 
frcxn dril roedlum to another^ knowledge utilization In different f 
contexts, ability to perceive broad rari If Icatlbhs of Ideas and 
eventis, etc.) In a wide range of student groups? 

• What Is the best way to teach sc lentl f Ic^ltfethdd^ and Cdflte'rjt to 
hori-sclehce students? ^ 

• What Is the most productive balance between general and speHlal 1st 
educatlbri In preparing students for work roles^ family roles, and 
citizenship roles? 
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- • How Important Is the coherence of Carrlcul om In ^promotthg generic 
learning? jn Increasing students* Ihvolvefneht In their academic 

environment? In Increasing the quality of their effort? • 

» - * ■' ■ - i ■ 

• What are^ th^effects of different forms of assessment oh student 
learning and development? . ^ 

Prc^l^ers > For bur purposes, a Uprbv Ider" ^Is any organ I zat I oh that offers 
fbrm^f^dergraduate education^ that can lead to a baccalaureate degree.; 
In higher education^ this def In It Ion covers approximately 3,200 colleges^ 
cofnmuhlty cp I leges and universities, as wel l as some programs' conducted 

under the auspices or corporations or public agencies. 

. ' ■ ■ . • » 

The Study Group Is aihcerhed with the question of how higher education 
■Inst I tut I gns can b^d more effective In undergraduate learning^ and with 
critical Institutional Issues (governance^ strategic planning, funding, 
internal resource allocation, faculty reward systems^ and Institutional; 
adaptation to new ciarkets and missions) that condition the effect I yehess 
of colleges and un^ vers It lei.* London's excellent treatrneht of the context 
of community colleges as they seek to meet the needs of diverse clientele 
and Ellas BiaKe's testimony on the contributions of h I stdP- lea I ty Black 
cbj leges are useful i To obtain a more comprehensive picture of 
pbstsecbhdary education^ however, the Study Groupbel leves that additional 
fnfbrmatlbh Is heeded on the speblal problems of research universities, 
liberal arts colleges^ regional universities, and community colleges. 

Because our cnarge Is more focused on the quality factor Irx^gher - ^' 

education than those of other groups^ we have cxwimUslbned a '^^^les of. 

papers on the cnaracter-^l sties, status, virtues and special circumstances 

of these major types of pos+secondary |nstltut Ibhs^ 

• . ; 1 . . • " * • ■ _ 

" 16 ' 
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V ■ 

_ We have also commissioned and received a paper on characteristics of*' - 

T effective colleges and uhlversftles, and believe that that analysis can* be 

e>i;teTlded Ih I Ight of both the effective schools I Iterature that Is In the 

Ckxnmlssldh's archives (the three papers by Farrar, Neufeld and Miles) and 

Michael CdHen's f-Ihe work at NIE, Ih preparing our Final Report, we 

Intend to devote Intense discussldri to the linking of student outcomes to 

i_ ^ 

-y jnstltut.lonar performance and the relationship between costs and learning^ 

'The fbi lowing questions will form the basis of th^se dlscussfbhs: 

, - ... - ^ ^ ' .. - . 

• Bhat are the organizational barriers to student learning and 
development, an^ what are some proven effective strategies for 



•overcoming those barriers? 

Given the character 1st 1 95^ of effective colleges and universities. 



\ 



hbW does one acnieve them? 



What are the effects of the different kinds of resources (e.g. 
faculty^ facilities^ student services) and their allocation on the- 
qua I Ity Of pdstsecdridary^educarro^ offered to different groups of 
students? V ' ^ ^ - , 

Externa I I nf 1 uences^ I n exam Ip Ing the Commission ' s background materials^ 

the Study Group was looking for guidance and Information on societal 

changes which affect the gba-ls^ conduct^ outcomes and support for hjghei^ 

education. Th'fere w^re 1 rid I rect^ analysed of thoTrrls^ of social 

^ ■ . ^ . '' ■ 

expectations as an Influence oh pbstsecdrid education (Rudolph) arid on 

^ th0 relatlonsH Ip Of education to the ,i^kp lace. As both t^e workplace arid 

'adult work roles 'are chjinglng, this la['"ari extradrd Iriarl I y Impbrta^ topic, 

with complex postsecondary dlmen^jpris.^ The testlrr^riy to the eommissloh 

' /.-to' ' ' \ • ■ 



cited rurai /urban contexts for student career expectations rDlckinson); 
the pressures of the economy on changes In the curriculum (Schwartz)^ the 
rdje of cooperative educatloh In preparing students for work (Weiss) ^ arid 
Federal OTiplbymerit and training policy (Saks). Hav Ing v Islted a number of 
corporate educatlori programs^ there Is evidence that the Commission and 
staff thought through the problwn of redundancy In bdr edicatlona j systwi 
and the question of who should prbvlde what pieces of postsecondary 
, education. But It Is also evident from the arch Ives: that the eommlsslon 
concluded (correctly, we would add) that we do riot kriow enough about the 
problem to answer the questlbri,^ 

it Is our Intention In prep^ir I rigour F I rial Report to pay great heed to the 
relationship between higher education arid Its external erivlrbnmerit. Iri'Sb 
doing, we are Interested In both tJle macrb dimirislbns of thjs tbpic, e^g. 



• What are the benefits to society from educating people of differerit 
abilities through the baccalaureate level? 

arid the micrb dlmerislbris^ e^gi _ 

• To what extent do the varJbus forms of accreditation promote - 
excel lerice Iri uridergraduate educatlori? 



The Outcomes t)f PoBt^Bc^^r y Fducatlori 



__ _ : : \ ■ ■ 

The collections of background materials we examined Include smge Irifbrmatlbri on 



both the outcomes of postsecoridary educatlori arid ways bf assess I rig those 
outcomes. But more solid data arid Iritbrmatlbri Iri these areas Is 
extraordinarily Important to the national dlscusslori bf standards arid 
requirements In education, , , 
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The; archives of the Na|lNoiial eommissron ,6n Esccei lence in Educatlbh contain the 
ffiost relevant material here. That material Inciude^ a set of data bh 17 years 

■ _ ■. 

(1965-1982; of standardized test scores of both high schodi and cbl leqe* 

- ■ . — g> ^ . 

gra(tuates, and some bacRgrdohd Information on the 'character I sties of the , *^ 

/ test-takers. Our stafthas analyzed this material, and found additional data 

are needed #o be able to explain what has happened with these v^ry syrriboJ Ic and 

- ; f__L_ _ __:_ > . y . _ _ . ' , , : 

ptibi Icly ^acb^slble measurgs of student learning. ' 

, . ■ ^' 

TheNetE arcnives also Include a number of profiles of different approaches to 
assessBient usei^ln a variety of colleges and un-l vJrfeltlesi ^^g; the value-aaded 
assessment program at Northeast Missouri State, the cornpeteney-based2.assessment 
pi-ogran at Alverno 661 lege, and the academic progression examinations used by. 
the Regents bt the University ot Georgia. And It Is evident from the archives 
that some of the Commissi oners examined and used a few of the" exper jmehtal 
assessment Instruments {the ebfnprehehs I ve Outcomes Measurefnent Project of the . 
American Cbl|jege Testing" Serv Ice: and the Academic Competences In General 
Education Examination of the Educati opal Testing Service) tfiat are slowly 
gaining currency In our Co I leges and universities. These experimental tests 
measure student growth In terms of higher order thinking capacities soch as 
anahysis and synthesis (and do so through a short written answer format), 
whereas the Commission's^ Interests seemed to He mbre In disclpl ihary content. 

The Importance of this material Is underscored by a few other papers In the 
archives that can be categorized^ "close-order thought" Oh the standards 
Issue. For example^ Adeimah's paper, "Standards as a Leading Tone In Higher 
Education," Is a useful analysis of some fundamental def In It Ions which plague 
i the national discussions ebbur standards. And a comparative and historical 
treatment of the standards Issue (Reshick and Reshick) firov Ides— among other 
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trenchant bbservat I bhs~th©^ notion that "Amer I c^^ students are the rribst 

over-tested and uhder-issessed In the world." The paper also explores the j 

proposition that our current col lection of standardized examinations are not 

safflclentiy tied to curriculum, and are not used very we I I for Individual 

guidance and placement,^ ^ 

* .... . . ■ . , ■ ^ . * ^ • • . . . % 

The Gommlsslon's^ category, "Expectations," overlaps some bf what we mean by "^.^ 

X ' * ♦ 

"outcomes^" and the archives evidence attention to the performance expectation? 

for cbj lege graduafes as expressed by wnployers. A systematic study bf 

empl oyer- prov Idea educatlbn Is needed to clarify the anecdotal Information and 

testimony In the archives about employer expectations. Those expectations are 

bften expressed Jn the standards Implicit In the content of employer screening 

examinations and job Interviews; What employers measure through those 

mechahisms are^ In effect^ outcomes of education. 

It is bur intentlbn to pay considerable attention to stffdent outcomes and the 
assessment issue In our Final Report since the essence of what we do In higher 
education Is student learning tirid growth i ' 

iii. Recommendat4Qfts - 

A. Issues Concerning Data 

One of the problems In research on higher education lies in the incohslstehcles 
and noncomparab 1 1 It les of the various data series available. More than bhe 
body In recent years has cornmented on the dlscoricertirig ways in which we gather 
and use educational data. The r«^ults are darnaglng to the accuracy and , \ 

timeliness ot- Institutional and state- level plannl ng and monltor^ing efforts, 
and to the appropriateness of public policies promulgated on the basis of 
mlsleadlhg^ Inc^wplete or contradictory data; 
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Un fortunately, edacatlon has nothihg comparable to the Bureau of tab^ 
Statistics In terms of the cc^prehenslveness and accuracy of research^-driven 
data seriesi Instead^ and particularly In higher educ^tlbh^ we have bits arid 
pTeces from the REGIS system at NCES, from the Census Bureau, from ACT surveys, V 
fron Ihtbrmatlon ga-fhered from financial aid recipients^ from Informatloh 

gathered from takers of standard Izea tests, etc. the coritrad tct I o'ris wid • : ' 

_ . i - ■ ■ ■ ' ' . ' • 

Inconsistencies that resul-t were evidenced In the backgrduri|l materials used by 

the varlcjus commissi 6nsi_ and were often resolyed by folk wisdom, speculation^ 
and preferred hypotheses i . ' 

< » 

It Is not bur function In this document to lay out a program for rectifying the ^ 
situatidh at the; Federal levej. But as the carrerit Admin I strat Ion (along wlth;^ 
Its predecessors) be I I eves that one of the key Federal roles In education lies 

_ _ _ ' . ^ . _ : _. . ' ' ^ 

In the gathering and ahalys.ls of data^ It Is time to review the workings^ 6t 
J. that role andl to Improve the way In which It Is carried buti We thus offer a 
variation on the recommendations made by NIE's Study Grbup on Pbst^econdary 

Research Centers In September^ 1985: - 

- f , 

_ * 

^ 1 ) He recommend that the Department of Education solicit advice from a 
broad crbss^sectlbrj bf the research cbmrfiunlty arid other Informed , 
parlies to assess the qua I I ty of current educatibnal data, to saggesl- 
the kinds of data series that ought tb be maintained, to reconsider 
the processes'by wh^Jch such data are collected In many agencies and to 
recommend reporting capacities that wquld be'useful tb the educational 

" - ^ ^ . : . • • ' . ■ i 

community at larger 

- " - " ^ c. ■ 

Beyond this fundamental reassessment, we think there arb^ sdme discrete 
data-gathering and clarif Icatlbn Issues that ppg and ought to be addressed'by 

_____ _ _ _ - * . . V' 

NIE and/or other organ I zat Ions: - ' ii 
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2J NIE should take a jeadership rdTe In the cbbpe native deveiopfneht of a 
• Systematic and contlnirlng data base (HE6IS could serve as brie starting 

points for nori-eol leg late etfUcatloh qnd training In th^ United States 

- - - - - ■_ _ _ ' ^. 

( Ihcludihg. the military and non-profit agencies such as the Red Cross^ 

■ \ ... ' . : - " - - ■ ^ '. 

Giri Scouts and United Way), /Thls <»6pera?j ve ^effort shou l<K Invpl ve* 

- . - . - j^ , •/ ■ • - ^ _ _^ jr: ^' ^ ^ 

' other agencFes of the Department of Education^ tbe Departrjerif of 

i-^bor, the Armed Forces train trig Ckwrnarid the National t Center for' 

eharltable Statistics, and the Amerlcaii ibclpty f6r_Tralhlng anS 

Deveiopjnent.: It Is est Iftia+ed "that, mueh»«bf the data oh th ls^hage and 

dmorphoas":*;seca?nd'systelr»»V of fk)stsecph<lary; educa'tlon a j ready exists In 

fragmented lorm. There ai^ two ^pbrtarit rea§cris f or brlr?§lfig the 

. pieced together: (rf) • without the ktidwiedge base that reliable data • 

, can provide, col lege and university plaririlrig will be hmpeLT'ed^ (b) 

vIrtuaMy aM of today's cx>I lege graduates will erigage In education 

thropghbut their lives, much of It In this '"second system." As a 

N»tlbn> we need. to know more about this yl+al resource, 

-- - • __ _ ' - __. _ _ ■ ' __ 

3) In brcj^r tb assist In the Implementation, of recommendatloii §2, we also 

r©cx>mmehd that NIE take the leadersh role within the Department of 

- . - V ■ _ : ' a : 

iducatlbh tft revltal Izlrig the Federal Interagency Commission on 
Education (Fltt); A f ew. ;yearS ^gb, FIGE^was an organization 
representing approximately 20 agericl^^ the federal government— from 
the mil It^iry to the i^atrbria I Science Fbundat I on—which had major 
educatlonar mlssjon^, and produced descriptive Irifbrmatlbribri those 
missions and programs that was useful tb a wide range of 

* ' i ■ : ■ » 

_i : ________ ^. ________ . _ 

constituencies. We bel leve that th Is Irifbrmatlbri should once again be 
aval lab 1 9. . . . 
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4) We recdmmehd the breatlbh of q Joint research odvlsbry committee 
invofving NIE, thi National Center for Education Statistics and the 
Office of Postsecondary Education to conduct small seminars over the 
next year on the subject of transcript analysis. We make this 
recommendation In light of the "Postsecohdary Transcript" study 
sponsored by the National Center for Education Statist lcs> the first 
phase of which Is currenPly being carried out by the National Opinion 
Research Center* This first phase Involves the gathering and coding 
of col lege transcripts from those students In the "High School and 
Beyond" sample (Class of 1980) who have attended postsecondary 
Institutions. The long-range effort implied by this Initial step is 
an extremely Important one slnce^ with the exception of -Blackburn's 
19/6 study of transcripts from a limited sample of colleges and 
universities^ there has been ho effort to examine the student 
experience of the pbstsecjpndary curriculum* The National Commission's 
study or high school transcripts demonstrated how valuable an effort 
such as this pan be. We thus believe it to be essential that research 
questions be Interjected at an early enough stage In the process so 
that the data encoded will be sufficiently malleable and productive. 

5) We recommend that a systematic and comprehensive approach to the 
coj lectlc^h of data bh adult learners In postsecondary baccalaureate 
education be Implemented^ Mpst of the I nf oration currently avaNabj^ 
about the parti cipatlbh of adults In undergraduate baccalaureate 
education Is fragmented and Incomplete beco.U|a^ we can collect It 
principally from full-time students ahd can ask questions bh^y from 
the student's perspective* We thljs recommend that NIE^ NCES^ other 
appropriate agencies In the Department of Education and other relevant 



non-federal res^earch agencies Irivaived in large-scaie research and 
data collation, design and test a procedure that WlJl Both reach 

partetlme students and gather Ihformatlbh f ran d"h© pars pe 

' _ . - .'^ 

iTist Itutlons of higher education, ' 

' ' ■' ■ • 1- • • ' ■ . 

- " - • • • • ■ s. . : ' 

6) Be urge that NIE convene an annual meetlng of the adirilnlstrators of 
the Graduate Record and other exam Inatlohs normal jy taken by <::dN^e 
: graduates to consider how the data generated from these examinations 
can be analyzed and dlssemlriated more effectlveiy, > They shoul'g-v-. 
consider de^h I hg a sample control group of test-takgrs thit catt^b^ 
. . monitored on a yearly basis so as to provrde a conjfjnulng fieasure- of 
ach leyeineht~at least .of those American students wh^ rntend^to 
continue their educatlori beyond the baccalaureate leveU Tbose who 
administer tests that Include achievement measures for hl^h school 
graduates should also be Included In tfie meetings 

National examinations can be one way of evaluat-^^ achievement levels 
In those cognitive areas coverecl by the Individual exams bh a natlbhal 
5asis. Furthermore, accurate and complete Wstdr lea I data concern I ng 
test scores and test-takers wil l al low for meanllri|ful historical 
cbmparl^Sbrisi Gareful distinct Iprts .should b between U.S» and 

foreign student data. 

For purpdses of this f Irst' report^ wfe. Have chosen not to rieommend yet another 
research agenda bri pbstsecbhdary eduj:atlon for NIE. As we pbjnted out at the 
beginning of this dbcumerit, such ah 'agenda shbuld be driven by recommendations 
for Improvesnent that are grburided In existing knowledge^ Thus, our detatled 
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